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I. INTRODUCTION 

In the following sections, we report briefly on the progress made in 
each of the indicated areas during Che period December 1, 1975 to May 31, 

1976, as well as on the plans, if any, to pursue further research in that 
area. 

II. CONVOLUTIONAL CODES 
A. Partial-Unit-Memory Codes 

In previous research under this grant, L. Lee developed Che class of 
unit-memor’> (UM) convolutional codes [1]. The UM codes are byte-oriented, 
and hence are natural choices for use as inner codes in concatenated coding 
systems having a Reed-Solomon outer code [2], 

In a UM code, the encoded branch of n^ bits at time t may be written 

■ “t S + it-i =1 

where u is the k bit information byte at time t, and where and G, are 

X n^ binary matrices. Implementation of (1) requires an encoder with at 

most k^ binary delay cells, namely those to store the components of 

[For a general convolutional code with memory M, where on the right in (1) 

there would be the further terms - G^ + . . . + u^ „ G, , at most Mk binary 

delay cells would be required.] This led Lee to define the state-complexity 

[which hereafter we shall refer to as the virtual state-complexity ] as k^ 

for UM codes (or, for general codes, as MK ] . 

o 

Lee showed that, for a given virtual state-complexity, the maximum 
free distance (d. ) over the class of all convolutional codes is achieved 

“ * ■ II I I - w 

within the class of unit-memory codes, and he found several cases of practical 
interest where the UM codes were strictly better than conventional 
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convolutional codes [i.e., codes where gcd(k ,n ) > 1] with the same rate 

o o 

R •• k /n and the same virtual state-complexlty [1]. This Is Important be- 
o o 

‘'v 

cause virtual state-complexity, Implies the upper bound 2 on the 
number of states In the corresponding Vlterbl decoder, a bound met with 
equality by all good conventional convolutional codes that have been proposed 
for use with Vlterbl decoding. 

It was realized by the principal investigator that the true state- 
complexity, y, of a unit-memory code is 

y “ rank (Gj^) (2) 

as can be seen from the following argument. Because y Is the rank of G^, 
there exists a non-singular k x k binary matrix T such that the matrix 

Q Q 

G* » TG, has only zeroes In Its first k -y rows and has y linearly inde- 
11 o 

pendent vectors In Its last y rows. Thus, the new unit-memory code, 
defined by Gq * TG and Gj^, is completely equivalent to the former code (same 
dfreg» same catastrophic properties, etc.), but Its encoding rule 

CJ + "t-i <=1 (3) 

can be implemented using only y delay cells since there is no need to 

store the first k -p components of ^ . For obvious reasons then, we call 

a UM code with p < a partial-unit-memory (PUM) code. Without loss of 

essential generality, we shall always take for a PUM code to be a matrix 

whose first k -p rows are all zeroes* 
o 

The principal investigator's interest in PUM codes began with his n >ting 

that Lee’s (n ■ 8, k » 4) UM code with p„ ® Mk “4 [which has d * 8] had 
o o Vo * 

1000101 i‘ 

11100010 
10111000 
11010001 

wh^*ch has rank only y ■ 3 [as can be noted most easily from observing that 
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its rows sum to the all-zero vector.] The transformation 


T - 


1111 
0 10 0 
0 0 10 


0 0 0 1 


then gives the u ■ 3 PUM code with 

'0 0 0 0 0 0 0 O' 

, 11100010 
'’l“ 10111000 

1101000 ij. 

This code also has d^ = 8 but requires only 2^ = 8 states in its Viterbi 

decoder; this should be compared to 2 =16 states for the parent UM code 

Mk 

and 2 ® ■ 32 states in the Viterbi decoder for the best rate 

R ■ k /n = 1/2 conventional code. This four-fold reduction in the number 
o o 

of states in the Viterbi decoder, between the PUM code and the best con- 
ventional code with the same d^ = 8, is graphic illustration of the practical 
potential of PUM codes as inner codes in concatenated coding systems. 

A detailed study of PUM codes has been undertaken by G. Lauer as his 
master's dissertation research under the direction of the principal investigator. 
This research is fully described in: 

G. S. Lauer, "Some Optimum Partial-Unit-Memory Convolutional Codes," 

Tech. Rpt. No. EE-767, Dept, of Elec. Engr. , Univ. of Notre Dame, Notre Dame, 

Ind. , July 28, 1976. 

In this report, Lauer gives PUM codes with y ■ h^“l having the same d^ 
as the best UM codes (but requiring only half as many decoder states) for 
the following cases: R • 1/A and y • 1,2,3 and A; R ■ 1/3 and y = 1 and A; 

R ■ 1/2 and y ■ 1 and 3; and R ■ 2/3 and y ■ 1 and 2. 

As Lauer* s new PUM codes appear to cover all cases of practical interest, 
no further searching for PUM codes is planned. 



B. Interleaving Requirements for Unit-Memory Codes 

For a concatenated coding system using an RS outer code together with 
an Inner convolutional code which is decoded by a Vlterbl decoder, it is 
necessary for good system performance that the inner code be Interleaved 
sufficiently so that, in each interleaved stream, the decoding errors of 
the Viterbi decoder appear to be independent [2]. Normally, this requires 
at least A+1 interleaved streams where A is the decoding delay [2]. 

Some preliminary experimentation with simple unit-memory (UM) codes 
has indicated that a decoding delay of only A» 1 may suffice to give virtually 
the same decoding error probability as the theoretically optimum A « 

This would be of considerable practical Importance in minimizing the inter- 
leaving requirements for the inner code of a concatenated coding system. 

This possibility is presently under intensive investigation by J. Tomclk, 
and it is expected that his research will be completed and reported in the 
next half-year. 

III. PHASE-TRACKING ERROR EFFECTS ON CODING PERFORMANCE 

One of the primary research goals for this grant has been the determi- 
nation of the effect of phase-lock loop (PLL) tracking error on the coding 
system performance. The keystone of our research into this topic has been 
usage of the channel cut-off rate , R^, as the measure of quality of a 
modulation system to be used with coding [3]. 

An Intensive investigation of the effect on R^ due to phase-tracking- 
error in the PLL is presently being conducted by S. Naraslmhan. His pre- 
liminary work indicates that, in the range of practical interest, this 

PLL tracking error places a penalty of about 2 db on R^, but that nearly all 
of this loss can be recovered by utilizing the receiver's estimate of the 
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tracking error. It la expected that this work will have progressed suf- 
ficiently so that a substantial initial report can be issued in the next 
half-year. 

IV. OPTIMUM MODULATION SIGNAL SETS 

Again with being used as the criterion of goodness for the modulation 
system, an extensive investigation has been made to find optimum modulation 
signal sets for a uon-white Gaussian noise channel. The non-white model was 
chosen to admit applicability of the research to real channels with memory 
effects such as intersymbol Interference. 

This research was undertaken by D. Bordelon as his master's dissertation 
research under the direction of the principal investigator. His results are 
fully reported in: 

D. L. Bordelon, "On Signal Design by the Criterion for Non-White 
Gaussian Noise Channels," Tech. Rpt. No. EE— 768, Dept, of Elec. Engr. , Univ. 
of Notre Dame, Notre Dame, Ind. , July 28, 1976. 

Perhaps the most interesting product of Bordelon's research was an 

heuristic selection rule for signal sets based on a "water-filling" argument. 

With infinitely many signals in the signal set and a Gaussian distribution 

on their usage, Bordelon found that the optimum (in the sense of maximizing 

R ) distribution of signal energy along each coordinate axis had a "water- 
0 

filling interpretation," similar to, but not coinciding with, the water- 
filling interpretation for the energy distribution when the signal set achieves 
channel capacity [4). Then, for a given finite number M of signals, Bordelon 
found that, when he selected the signals so as to yield the same energy along 
each coordinate axis as determined by the water-filling rule, the M-ary 
signal set was virtually optimum. Thus, Bordelon's heuristic signal selection 
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rule provides a simple method to select a *'good" signal set for channels 
with non-white Gaussian noise. 

No further research in this area is planned for the next half-year. 

V. DATA COMPRESSION 

Part of the research under this grant has been concerned with the use 
of error-correcting codes to perform "data compression" by the technique of 
syndrome source coding. This work is being conducted by T. Ancheta who, 
already under this grant, has developed an important practical extension 
[5] of syndrome source coding which he termed "noiseless universal syndrome 
source coding" (NUSSC). 

During this research period, Ancheta has developed strong bounds on the 
ultimate performance attainable with syndrome source coding. Letting R(D) 
be the rate-distortion function for the (asymmetric) binary memorylesp source 
(BMS) , Ancheta has shown that linear source encoding (of which syndrome source 
coding can be considered a special case) has an ultimate performance N^(D) 
such that N|^(D) ^ R(D) with equality when and only when D ■ 0 or D ■ p (where 
p is the probability that the BMS emits a 1.) Moreover, for any syndrome 
source coding scheme based on a code with partlally-symmetric Information 
sets (PSIS) , Ancheta has proved that an even stronger lower bound applies. 
lA code is said to have the PSIS property if there is a subset of its infor- 
mation sets (an information set is any set of k positions in which all 
2 codewords are distinct) which contains each position the same number of 
times, nils is a weak constraint satisfied by most codes, for instance, by 
all cyclic codes.] These results imply a dim future for syndrome source 
coding in situations where non-zero distortion in the reconstructed source 
output is acceptable. Fortunately for the future of syndrome source coding, 
the practical case of greatest interest is zero dlstorlton (i.e., "noiseless 
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coding") for which syndrome source coding gives the same ultimate performance 
as any form of source coding. 

Ancheta has also, during the past half year, been testing the effective- 
ness of NUSSC on real telemetry data obtained from the Goddard Space Flight 
Center. Preliminary results have been highly encouraging. 

It is expected that Ancheta will complete his investigation of data 
compression by syndrome source coding during the next half year and that a 
detailed report thereon will be issued. 

The principal investigator has developed a very simple data compression 
scheme, closely related to NUSSC and to Lynch-Davisson-Schalkwijk-Cover (LDSC) 
noiseless universal coding (cf. [5]), which may have practical applicability. 
We shall call this scheme the weight-and-error-locations (WEL) method of 
data compression. 

The WEL scheme operates as follows. Let m and r be any two given 
positive integers with r ^ m. Let e - [e^^, ••• ®n^ be n ■ 2® output 

bits from the source which, as the notation suggests, we are treating as an 
"error-pattern." If there are t non-zero bits in e (i.e. , t errors) where 
t < 2*^-1, then £ is encoded as w * * ... * (* denotes concatenation) 

where w is the m-bit radix-two form of t, and where (if the errors are in 
positions ij^ < i 2 < . . • < i^) is the m-bit radix-two form of ij^“l and 
£j, for 2 £ J £ t, is the m-bit radix-two form of ij-ij_j-l. Wlien t >_ 2*^-1, 
then e is encoded simply as _1 * £ where _1 denotes the all-one binary m-tuple. 
Note that both the source encoding and decoding could be accomplished in an 
obvious way using only two simple counters. 
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Example : With m ■ 4 (so that n ■ 16) and r •• 2, the WEL scheme would 

operate as follows: 


Weight of £ 

Form of encoded word 

Length of encoded word 

Compression factor 

0 

10 0) 

2 

8 

1 

(0 1) * 

6 

2.67 

2 

[1 0] * 2^ * 22 

10 

1.60 

> 3 

[in'*! 

18 

0.89 


When this scheme is used to encode a BMS with p " .0312, the attained 


compression ratio is 

16 

' Average Length of Encoded Word 

16 

2(l-p)^^+6(^^^)p(l-p)^^+10(^2^)p2(l-p)^Vl8[l-(l-p)^^-(\^p(l-p)^^-(^/)p^l-p)^ 


which should be compared to the theoretical limit y ■ 1/H(p) ■ 5 for any 
noiseless source coding scheme for this particular BMS. 

The WEL data compression scheme with r - m Is very closely related to 
LDSC coding. The only difference Is that, in the LDSC scheme, after sending 
the same heading w as in the WEL scheme, one sends the "index" of the error 
pattern in a list of all (^) n-tuples of weight w rather than simply the w 
locations of the one's. The LDSC scheme thus minimizes the number of bits 
used to identify the particular n-tuple £ of weight w at the cost, however, 
of a considerably more complicated coding rule. 

The WEL scheme Is also closely related to NUSSC in which £ is coded as 
w * £ where £ is the syndrome for £ in a particular t-error-correctlng code 
[S]. Thus, WEL differs from I^SSC in that the former specifies £ by the 
location of its t one's whereas the latter specifies £ by its syndrome with 
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respect to sone t**error~ccrrcctlng code. It is Interesting to note that the 
at digits used to specify the t error locations in WEL are precisely the 
number of syndrwne digits specified by the usual bound [6] for a t’-crror** 
correcting BCH code of length 2***-l ■ n-1. Thust the efficiencies of WEL 
coding and NUSSC will generally be very nearly the same for the cases of 
practical interest where this bound mt for the number of syndrome bits in 
the BCH code is either exact or very tight. Moreover, the WEL scheme appears 
even simpler to Implement than NUSSC. 
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